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Abstract 

We give a simple recipe based on the use of discrete derivative, to 
obtain generalized bit-moments obeying nonadditive statistics of Tsallis. 
The generalized bit-cumulants may be of two kinds, first which preserve 
the standard relations between moments and cumulants of a distribution, 
and are nonadditive with respect to independent subsystems. The second 
kind do not preserve usual moment-cumulant relations. These are additive 
in nature and Renyi entropy is naturally incorporated as the cumulant of 
order one. 
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1. Introduction 



The last decade saw an increasing interest in a nonextensive generalization of 
Boltzmann-Gibbs statistical mechanics, popularly called as Tsallis statistics. It 
is based on a nonadditive entropy, dependent on a real positive parameter q. 
Maximising Tsallis entropy under suitable constraints, leads to power-law type 
distributions which have been applied to various classes of physical systems and 
models, for example, fully developed turbulence, low-dimensional maps at onset 
of chaos, Hamiltonian systems with long-range interactions etc. (see Ref. for 
a complete list of references.) Apart from these, it has motivated extension of the 
axiomatic foundations of information theory as well as development of new 
mathematical tools and quantifiers [0]. 

In this spirit, the classical bit cumulants were generalized |Q within nonexten- 
sive thermodynamic approach. Bit statistics is a tool to describe the complicated 
probability distributions, such as generated by chaotic systems. Particularly, the 
second bit cumulant which is a generalization of specific heat, can be applied 
in the context of equilibrium and non-equilibrium phase transitions |^. The 
g-generalized second bit cumulant has been applied to study the issue of sen- 
sitivity to initial conditions in asymmetric unimodal maps at the threshold of 
chaos. 

In this letter, we show that these generalized bit- moments and cumulants 
can be generated simply by introducing a discrete derivative in place of usual 
derivative into their definitions. The generalization we aim at can be achieved 
in two ways: (i) only generalize the bit-moments and then use the standard re- 
lations between bit-moments and bit-cumulants to define generalized cumulants, 
which yields g-cumulants of Ref. [Q; (ii) generalize the moments and cumulants 
independently from their basic definition (see below), using the discrete deriva- 
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tive. This procedure does not preserve standard relations between moments and 
cumulants. 

First we briefly review the moments and cumulants in the Shannon-Gibbs 
bit statistics. Given a probability distribution {pi\x = Xj}j=i^...^vK for a discrete 
random variable x, kth order moments of the distribution are defined as Mk = 
Yh^i Xi'^Pi- It is useful to define a generalized partition function, Z{a) = Y,i Pie'^^\ 
Then moments of the distribution {pi\ are given as 



A4 = |jZ(.; 



o-=0 



Similarly, the cumulants for the distribution may be obtained from a generating 
function G{a) = In Z, as follows 



(2) 

o-=0 



Let us take x to be the fluctuating bit number, —In pi = —ai. Thus the relevant 
partition function is 

Z{a) = Y.P^e""'^. (3) 

i 

Now within the above statistical analysis, the first cumulant Ci (which is also 
equal to first moment Mi) is the average value of the bit number. In the present 
context, it is equal to Shannon entropy. The second cumulant is given by C2 = 
X)i(ln Pifpi — (Z^iPilii PiYi and is called the bit variance. Realizing that within 
Tsallis' framework, the generalized bit number can be given by 

- M = ^ , (4) 

where from now on we imply A = {1 — q), a generalization Q of standard cu- 
mulants was considered by modifying the partition function in Eq. based on 
[ttj] instead of a^. Such a generalization of second bit cumulant has found an in- 
teresting application in low- dimensional maps at chaotic threshold. Note that in 



applications of Tsallis formalism to such systems a critical value oi q = q* exists, 
which may be inferred from the study of sensitivity to initial condition [0 or from 
the multifractal spectrum of the attractor at chaotic threshold Although, a 
priori, q introduced above is a free parameter, it is found to behave like the critical 
index q* in quantifiers such as the generalized second bit cumulant. This implies 
that 0] information about relation of Tsallis index q* and inflexion parameter z 
of the nonlinear mapping can be reliably obtained, where it is difficult to do so 
by other techniques (see also 0). 

2. Method (i) 

In the following, we show that moments of the above bit number in Eq. 
can be obtained by modifying the derivative rule in the Eq. (|I|), but keeping 
the partition function of Eq. @ unchanged. We simply replace the ordinary 
derivative with respect to a by a discrete derivative operator defined as follows 

Naturally, as A = (1 — — > 0+, we get back the ordinary derivative. Now we 
make the substitution 

Z{a)^diZ{a). (6) 



da'' 

In other words, the g-moments of order k, are defined as 

mI'^ = dl^Z{a)\.=o. (7) 
It can be easily verified that the g-moment of order 1 is 



q-l ' 

which is Tsallis entropy. Pseudoadditivity of Tsallis entropy can be understood 
as originating from the modified Leibnitz rule 

dA,xf9{x) = dA,xf{x)g{x) + f{x + A)dA,x9{x) (9) 



d^,xf{x)g{x + A) + f{x)dA,xg{x). 



(10) 



In general, we have 



Note that generahzed bit number — [cti] of Eq. (|^) appears automatically by 
operating discrete derivative on the "classical" partition function, Eq. (^. To 
obtain g-cumulants, we have to consider the rule in Eq. (^ again. For that 
purpose we note that 



Thus g-cumulant of order 1 can be written as 



(7=0 



CI 



(<?) 



o-=0 

(?) _ 



(12) 



(13) 



Due to the normalization Z(a = 0) = 1, C} = M| . Similarly, we have 



1 



Zda^ 

Applying rule of Eq. (H) , we have 



(T=0 



cr=0 



Z2 I da 



- ^(9A,.^(a))^ 



CT=0 



(14) 



(7=0 



(15) 



and so on for higher order g-cumulants. Note that is the variance of the 
generalized bit number — [oj] in the same way as C2 is the variance of the classical 
bit number —In pj. In the above scheme, we have effectively generalized the 
standard bit moments to q'-moments and then g-cumulants follow as a result of 
standard relations between moments and cumulants of a distribution. In this 
way, we maintain the usual meaning of moments and cumulants of a distribution. 

3. Method (ii) 

Naturally, one cannot claim a unique way to define the generalized bit mo- 
ments as well as the cumulants. This problem is similar to the one of defining 



a (multi)parameter dependent generalization of Shannon entropy, where some 
physical/mathematical principle is required to motivate the generalization. For 
example, seeking the form invariance of certain mathematical relations can re- 
quire the valid generalized entropy to be an appropriate renormalisation of Tsallis 
entropy |10|. In this sense, our method (i) is motivated by the requirement of 



keeping the standard meaning of bit moments and cumulants, and also the rela- 
tions between them. Otherwise, the use of a modified derivative operator offers at 
least one more possibility to define a generalization of the standard bit cumulants. 
The new rule may be given as 

Compare this with Eq. (^. Then applying the above rule to Eqs. (|I|) and (^, 
we note that g- moments remain the same as given by Eq. (|^, but g-cumulants 
are a new set of quantities given by 

Cl'^ = diM^)\.=o. (17) 
This generalization seems interesting due to the fact that the first g-cumulant is 



which is Renyi entropy with index q [11|. This distinguishes Tsallis entropy and 



Renyi entropy, based on the use of discrete derivative: Tsallis entropy is obtained 
from Z, while Renyi entropy follows from the generating function G = In Z. 
Also this definition of Renyi entropy potentially connects it to non-commutative 
differential calculus |T^ which is based on discrete derivative. 



However, it should be pointed out that in method (ii), the standard relations 
between moments and cumulants cannot be preserved. Thus as is already evident, 
the first g-cumulant is not equal to first g- moment. This implies that Renyi 
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entropy cannot be inferred here as a simple expectation value of some generalized 



bit number. In fact, it can be written only as a kind of nonlinear average |]T3 
Similarly, the g-cumulant of order 2 is given by 



^2 



1 



(19) 



(l-g)2 

which is not equal to the bit variance of generalized bit number — [oj], given from 
Eq. dH) as 



a 



1 



(20) 



Thus there does not appear to he a generalized hit numher connected with Renyi 
entropy, unlike — [flj] for Tsallis entropy. However, these quantities do go back to 
the standard bit variance in the limit q ^ 1. The positivity of Cq^'' follows from 
the similar property of C'2'' ■ Thus if Cq^'^ is considered as generalization of 6*2^^ 
then it is interesting to see the implications of using instead of in such 
systems as, for example, low dimensional maps along the lines of Ref. [Q. Such 
a comparative study can help to elucidate the separate roles of Renyi and Tsallis 
entropies in these systems when they exhibit power-law behaviour |l^ . 



After observing that discrete derivative may be relevant for Renyi entropy. 



we consider the special case of multifractals [|T5|. For such measures also, we can 
define a generalized partition function Z{j3) = J2i{Pi)'^, where the sum ranges 
over boxes of size /. We note that Z{p) and Z{a) in Eq. (^) are equivalent 
and (3 = 1 — a. Thus discrete derivative can be expected to be significant for 
multifractal measures also. For length scale I —>■ 0, the partition function scales 
as 

Z{P)=Y.iP^f-l-^^^^■ (21) 

i 

The measure is characterized by a whole sequence of exponents t(/3), given by 



1^0 In/ 



(22) 



Choosing different values of P helps to scan subsets with different probability 
strengths scaling as pi ~ 1°''. These properties can be expressed by taking the 
derivative of r(/?) as 

Let us replace the ordinary derivative by the discrete derivative and taking into 
the fact that /3 = 1 — cr, we find that 

S.,,r(/3) = -li,„l„(^g^)/Al„i. (24) 

We find that 

5a,/3t(/3)|/3^oo = -"max, (25) 

and 

5a,/3t(/3)|/3^-oo = -ttmin, (26) 

where Omax and cvmin are the end points of the multifractal spectrum. These re- 
sults are just the same as will be obtained by working with Eq. (|2^). This is 
reasonable, as discrete derivative in P measures the change in function with re- 
spect to a finite increment A. As \P\ —>■ oo, any finite increment A is infinitismally 
small relative to the magnitude of\P\ and so we expect discrete derivative to yield 
same result as the usual derivative in this limit. However, for finite P such as 
equal to unity, we have 

aA,.r(/3)|,.. = ^lim!!i^ = Z)„ (27) 

which is the definition of generalized dimension. This again illustrates that dis- 
crete derivative is the generator of Renyi information, where using the ordinary 
derivative would give Shannon information 



= limE^. (28) 
p=i 1^0^ In/ ^ ^ 



4. Concluding remarks 

We have used discrete derivative to obtain generalized bit moments or cumulants 
and within that, we have noticed the basis to distinguish Tsalhs and Renyi en- 
tropy. Tsalhs entropy has been previously related to Jackson's g-derivative and 
this observation motivated the search for connections between quantum group 



theory and nonextensive statistics |16|. In fact, it is well known that discrete 
derivative and Jackson derivative can be mapped onto each other Briefly, 
the discrete translation produced by the former operator correspond to dilatation 
by the latter. Thus the modification of the derivative in Eq. can be written 
equivalently as 

Z{<y) - {-yDy,,fZ{y), (29) 



where Dy q is the Jackson derivative operator 

DyJiy) = • (30) 

The variable y is defined a.s y = e~'^ . Note that the operator {—yDy^qY goes to 
as g — i> i. 

Secondly, as both Shannon and Renyi entropies are additive with respect to 
independent subsystems, and nonadditivity has been thought to be related to 
Jackson derivative, it seems Renyi entropy may not have any connection with 
discrete derivatives. This is somewhat surprising as Jackson derivative seems 
relevant for multifractal sets lll^ and Renyi entropy has also proved useful for 



such systems [|T8|. After showing above that discrete derivative is the generator of 
Renyi entropy, we point out that it is also consistent with the additive property of 
Renyi entropy which has been derived here from the generating function G = In Z. 
Thus for independent subsystems A and B, Z{A + B) = Z{A).Z{B) and so the 
generating function is additive G{A + B) = G{A) + G{B). Now the discrete 
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derivative is distributive: 



dA,x{f + 9){x) = dA,xf{x) + dA,x9{x). (31) 

and additivity of Renyi entropy follows directly from this. 

In general, we observe that cumulants of method (i) are nonadditive with 
respect to independent subsystems, whereas those of method (ii) are additive in 
nature. Thus based on discrete derivative, for one class of (nonextensive) q'-bit 
moments in Eq. (0) , we have two classes of g-bit cumulants distinguished by their 
additive properties. Tsallis and Renyi entropies have been cast here in the more 
general framework of bit-moments and cumulants. Particularly, the concept of 
biased averaging J^iiPiY found in both the entropies is shown to have its origin 
in the finite increment induced by discrete derivative or equivalently, dilatation 
induced by Jackson derivative. It is hoped that the present approach will help in 
better understanding the origin and connection between these entropies. 
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